Information processing device and information processing method

ABSTRACT

An information processing device according to the present disclosure includes: an acquisition unit that acquires outline information indicating an outline of a user who makes a body motion; and a specification unit that specifies, among body parts, a main part corresponding to the body motion and a related part, which is to be a target of correction processing of motion information corresponding to the body motion, on the basis of the outline information acquired by the acquisition unit.

FIELD

The present disclosure relates to an information processing device andan information processing method.

BACKGROUND

In recent years, a technology of performing various kinds of processingby using information related to a body motion (gesture) of a user isknown. For example, a technology that uses a body motion of a user as aninstruction to execute a function of equipment (operation of equipment)is known (for example, Patent Literature 1). Furthermore, a technologyof generating content including a virtual character that makes a motioncorresponding to a body motion of a user is known (for example, PatentLiterature 2).

CITATION LIST Patent Literature

-   Patent Literature 1: WO 2016/167331 A-   Patent Literature 2: JP 2016-517557 A

SUMMARY Technical Problem

According to the related art, a function of equipment is executed orcontent including a virtual character is generated by a body motion of auser.

However, in the related art, it is not always possible to appropriatelyspecify a part related to the body motion of the user. For example, inthe related art, motion information of a body part of the user is usedwithout distinction of each part, such as whether the part is a mainpart a motion of which is intended by the user with respect to the bodymotion of the user. As a result, in a case of the related art, there isa possibility that a position change of a body part which change is notintended by the user is recognized as equipment operation by the user,or a motion of the virtual character becomes insufficient. Thus, it isdesired to appropriately specify a part related to a body motion of theuser.

Thus, the present disclosure proposes an information processing deviceand an information processing method capable of appropriately specifyinga part related to a body motion of a user.

Solution to Problem

According to the present disclosure, an information processing deviceincludes an acquisition unit that acquires outline informationindicating an outline of a user who makes a body motion; and aspecification unit that specifies, among body parts, a main partcorresponding to the body motion and a related part, which is to be atarget of correction processing of motion information corresponding tothe body motion, on a basis of the outline information acquired by theacquisition unit.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a view illustrating an example of information processingaccording to a first embodiment of the present disclosure.

FIG. 2 is a view illustrating a configuration example of an informationprocessing system according to the first embodiment of the presentdisclosure.

FIG. 3 is a view illustrating a configuration example of an informationprocessing device according to the first embodiment of the presentdisclosure.

FIG. 4 is a view illustrating an example of a motion information storageunit according to the first embodiment of the present disclosure.

FIG. 5 is a view illustrating an example of a part information storageunit according to the first embodiment of the present disclosure.

FIG. 6 is a view illustrating a configuration example of a terminaldevice according to the first embodiment of the present disclosure.

FIG. 7 is a flowchart illustrating a processing procedure of theinformation processing device according to the first embodiment of thepresent disclosure.

FIG. 8 is a sequence diagram illustrating a processing procedure of theinformation processing system according to the first embodiment of thepresent disclosure.

FIG. 9 is a view illustrating an example of part specification usingspeech.

FIG. 10 is a view illustrating an example of information processingaccording to a second embodiment of the present disclosure.

FIG. 11 is a view illustrating a configuration example of an informationprocessing device according to the second embodiment of the presentdisclosure.

FIG. 12 is a view illustrating an example of part specification usingspeech.

FIG. 13 is a view illustrating an example of information utilizationaccording to an attribute.

FIG. 14 is a view illustrating an example of motion editing.

FIG. 15 is a hardware configuration diagram illustrating an example of acomputer that realizes the information processing device, or functionsof the information processing device.

DESCRIPTION OF EMBODIMENTS

In the following, embodiments of the present disclosure will bedescribed in detail on the basis of the drawings. Note that theseembodiments do not limit an information processing device and aninformation processing method according to the present application.Also, in each of the following embodiments, overlapped description isomitted by assignment of the same reference sign to the same parts.

The present disclosure will be described in the following order ofitems.

1. First Embodiment

1-1. Outline of information processing according to the first embodimentof the present disclosure

1-1-1. Background and effects

1-1-2. Application example

1-2. Configuration of an information processing system according to thefirst embodiment

1-3. Configuration of an information processing device according to thefirst embodiment

1-4. Configuration of a terminal device according to the firstembodiment

1-5. Procedure of the information processing according to the firstembodiment

1-5-1. Procedure of processing related to the Information processingdevice

1-5-2. Procedure of processing related to the information processingsystem

1-6. Example of part specification using speech

2. Second Embodiment

2-1. Outline of information processing according to the secondembodiment

2-1-1. Background and effects

2-2. Configuration of an information processing device according to thesecond embodiment

2-3. Example of part specification using speech

2-4. Example of information utilization according to an attribute

2-5. Motion editing example

3. Other embodiments

3-1. Other configuration examples

3-2. Others

4. Effects according to the present disclosure

5. Hardware configuration

1. First Embodiment

[1-1. Outline of Information Processing According to the FirstEmbodiment of the Present Disclosure]

FIG. 1 is a view illustrating an example of information processingaccording to the first embodiment of the present disclosure. Theinformation processing according to the first embodiment of the presentdisclosure is realized by an information processing system 1 (see FIG. 2) including an information processing device 100 and terminal device 10illustrated in FIG. 1 .

The information processing device 100 is an information processingdevice that executes the information processing according to the firstembodiment. The information processing device 100 specifies a partcorresponding to a body motion of a user on the basis of outlineinformation indicating an outline of the user who makes the body motion.In the example of FIG. 1 , a case where sensor information (imageinformation) detected by an image sensor 171 of the terminal device 10(see FIG. 6 ) used by the user is used as appearance information isillustrated. Note that a sensor that detects the outline informationindicating the outline of the user is not limited to the image sensor171, and may be any sensor as long as the outline information of theuser can be detected. For example, the sensor that detects the outlineinformation indicating the outline of the user may be an optical rangingsensor, an acoustic wave sensor using an ultrasonic wave, or the like.For example, the sensor that detects the outline information indicatingthe outline of the user may be a light detection and ranging or laserimaging detection and ranging (LiDAR) or time of flight (ToF) sensor, orthe like. For example, the sensor that detects the outline informationindicating the outline of the user may be a sensor that detects heat,such as a thermal sensor. As described above, as long as the outlineinformation indicating the outline of the user can be detected, theinformation processing system 1 may detect the outline information byusing any sensor.

Hereinafter, FIG. 1 will be specifically described. In the following, acase where a user U1 who uses the terminal device 10 performs an inputto the terminal device 10 by making a body motion will be described asan example. First, in the example of FIG. 1 , the terminal device 10detects image information acquired by imaging of the user U1 by theimage sensor 171 (Step S1). Then, the terminal device 10 transmits thedetected image information as outline information to the informationprocessing device 100 (Step S2). For example, the terminal device 10transmits moving image information including a plurality of pieces ofcontinuously captured image information to the information processingdevice 100 as the outline information. For example, the terminal device10 transmits, as the outline information, moving image informationincluding a plurality of frames to the information processing device100.

As a result, the information processing device 100 acquires, as theoutline information, the moving image information including theplurality of frames. The information processing device 100 acquires theoutline information indicating the body motion of the user U1. In theexample of FIG. 1 , the information processing device 100 acquires, asthe outline information, a plurality of pieces of image information suchas image information corresponding to a state ST1 and image informationcorresponding to a state ST2. Note that the information processingdevice 100 may generate motion information corresponding to the bodymotion of the user between the state ST1 and the state ST2, or mayacquire motion information corresponding to the body motion of the userbetween the state ST1 and the state ST2 from an external informationprocessing device.

The information processing device 100 that acquires the outlineinformation performs processing of specifying a part corresponding tothe body motion of the user U1 by using the outline information. First,the information processing device 100 specifies a part corresponding tothe body motion of the user U1 (hereinafter, also referred to as “mainpart”) (Step S3). The information processing device 100 specifies, asthe main part, a part having a large amount of change in the body motionof the user U1 between the state ST1 and the state ST2. In the exampleof FIG. 1 , the information processing device 100 specifies, as a mainpart M1, a head HD that is a part having a large amount of changebetween the state ST1 and the state ST2 among body parts of the user U1.For example, the information processing device 100 extracts a differencebetween a first frame (first image information) corresponding to thestate ST1 and a second frame (second image information) corresponding tothe state ST2, and specifies the head HD, which is the part having thelarge amount of change, as the main part M1.

Furthermore, the information processing device 100 specifies a motiontype of the user U1 between the state ST1 and the state ST2 (Step S4).The information processing device 100 specifies the motion type of theuser U1 on the basis of a motion of the head HD that is the main part M1between the state ST1 and the state ST2. In the example of FIG. 1 ,since the user U1 makes a motion of tilting (rotating) the head betweenthe state ST1 and the state ST2, the information processing device 100specifies the motion type as “ROTATE”.

Then, the information processing device 100 specifies a part to be atarget of correction processing of the motion information correspondingto the body motion (hereinafter, also referred to as “related part”)(Step S5). The information processing device 100 specifies the relatedpart on the basis of the head HD that is the main part M1 between thestate ST1 and the state ST2 and the motion type “ROTATE”. For example,the information processing device 100 specifies the related part byusing definition information indicating association between the mainpart and the related part. For example, the information processingdevice 100 specifies the related part by using data definitioninformation (main part/related part information) of a part that may makea motion along with each body part. For example, the informationprocessing device 100 specifies the related part by using definitioninformation stored in a part information storage unit 123 (see FIG. 5 ).In such a manner, the information processing device 100 acquirescorresponding related part data, and specifies the related part by usingthe acquired information.

In the example of FIG. 1 , the information processing device 100specifies the related part by using, among pieces of the definitioninformation, association information INF1 in which a combination of themain part “HEAD” indicating the head and the motion type “ROTATE” andthe related part are associated with each other. As a result, theinformation processing device 100 specifies a right wrist RW and a leftwrist LW of the user U1 as related parts corresponding to the motion ofrotating the head by the user U1.

The information processing device 100 specifies, as the related parts,the right wrist RW and the left wrist LW of the user U1 among five bodyparts that are a body BD, the right wrist RW, the left wrist LW, a rightleg RL, and a left leg LL of the user U1 which parts are other than thehead HD that is the main part M1. Note that the body parts of the usermay be divided in more detail although only six parts are illustrated asthe body parts in FIG. 1 in order to simplify the description. Asdescribed above, in the example of FIG. 1 , the information processingdevice 100 specifies the right wrist RW as a related part R1, andspecifies the left wrist LW as a related part R2.

Then, the information processing device 100 performs processing ofcorrecting the motion (Step S6). The information processing device 100performs a correction of cancelling the motion of the related part. Inthe example of FIG. 1 , the information processing device 100 performscorrection of cancelling the motion of the right wrist RW that is therelated part R1. That is, the information processing device 100 performsthe correction of returning a position of the right wrist RW in thestate ST2 to a position of the right wrist RW in the state ST1. As aresult, the information processing device 100 corrects the state ST2before the correction to a state in which the position of the rightwrist RW is returned to the position of the state ST1 and only the headHD is tilted as in a state ST3 after the correction. Note that sincethere is no change in the position between the state ST1 and the stateST2 with respect to the left wrist LW that is the related part R2,correction is not performed for the left wrist LW. However, in a casewhere there is a change in the position of the left wrist LW, the motionof the left wrist LW may also be canceled. Then, by using motioninformation corresponding to the state ST3, the information processingdevice 100 estimates intent of an input by the body motion of the user.For example, the information processing device 100 specifies the intentof the input by the body motion of the user by inputting the motioninformation corresponding to the state ST3 to a detector or the like.

In such a manner, the information processing device 100 specifies themain part corresponding to the body motion of the user on the basis ofthe outline information, and specifies the related part on the basis ofthe specified main part and motion type. As a result, the informationprocessing device 100 can specify the main part that is the partcorresponding to the input intent of the user, and the related partwhere the motion is generated along with the motion of the main part.Thus, the information processing device 100 can appropriately specifythe part related to the body motion of the user. Here, when a persontilts his/her head (head tilting), movement of a wrist on an oppositeside of a tilting direction is generated unconsciously. In a case wherethere is a function with respect to such a motion of the wrist exists,erroneous activation thereof may be caused. Thus, by specifying thewrist of the user as the related part and correcting the motion of thewrist in a case where the user tilts the head, the informationprocessing device 100 can control the erroneous activation of a casewhere there is the function with respect to the motion of the wrist.

Then, by canceling the motion with predefined data, the informationprocessing device 100 can control an influence of the body motion of theuser which motion is generated depending on a skeleton or the like ofthe user. The information processing device 100 can more accuratelyrecognize the input by the body motion of the user by using the motioninformation in which the motion of the part other than the head HD thatis the main part M1 is canceled as in the state ST3 after thecorrection. Note that the information processing device 100 is notlimited to the case of canceling the motion of the related part, and mayperform correction of reducing the motion of the related part.Furthermore, the information processing device 100 may performcorrection of emphasizing the motion of the related part. This pointwill be described later in detail.

[1-1-1. Background and Effects]

Conventionally, an interface using a body motion of a user limitedlyuses a gesture command or the like. However, in recent years, it becomespossible to sense detailed body motions, and interaction to which thesepieces of motion information are applied is expanded.

Then, as described above, even in a case where the user intentionallymoves a specific body part, there is a case where a part other than theintentionally-moved part unconsciously moves due to physicalcharacteristics or the like. Such an “unconscious motion” of the usercauses false recognition on a system side.

On the other hand, the information processing device 100 leaves onlyactual motion intent of the user by specifying a body part that isunconsciously moving from the motion of the user and canceling themotion. As a result, the information processing device 100 canappropriately specify the part related to the body motion of the user.

[1-1-2. Application Example]

The information processing device 100 may be applied to various kinds ofservices, processing, and the like. An example of this point will bedescribed in the following. Note that the application described in thefollowing is merely an example, and may be applied to any service orprocessing as long as the application is possible.

The information processing device 100 is not limited to the casedescribed with reference to FIG. 1 , and may be applied to instantequipment control using a body motion. For example, the informationprocessing device 100 may be applied to a service provided by a TV, asmart speaker, a smartphone, or the like. For example, the informationprocessing device 100 may be applied to a service using a smart speakerwith a camera.

Furthermore, the information processing device 100 may be applied to aservice that posts a moving image or distributes a moving image by usingcomputer graphics or a (virtual) character (avatar). In this case, it ispossible to express a characteristic of the character by using a motionof only an intended body part or changing a correction method accordingto character (attribute) of the avatar instead of using the motion dataas it is, for example. For example, it is possible to express thecharacteristic of the character by changing the correction method of thecharacter (attribute) such as a gender or age of the avatar. Note thatthis point will be described later in detail in and after FIG. 10 .

Furthermore, the information processing device 100 may be applied topractice or image creation of sport or the like. In this case,application to promotion of the practice or image creation may beperformed by visualization of an ideal state of motion of the user byutilization of control information acquired, for example, from a motionof a user such as a professional (player) of sport or the like or anexpert of a certain technology (also referred to as “model user”). Theinformation processing device 100 may use, as the control information,information generated from motion information of the model user. Forexample, the information processing device 100 may use, as the controlinformation, definition information in which a main part and a relatedpart based on the motion of the model user are associated. For example,the information processing device 100 may correct a motion of a userother than the model user (also referred to as “normal user”) on thebasis of the control information. As a result, the informationprocessing device 100 can correct the motion of the normal user to anappropriate motion on the basis of the motion of the model user.Furthermore, the information processing device 100 may provide thenormal user with information indicating the motion of the normal userwhich motion is corrected on the basis of the motion of the model user(also referred to as “corrected motion information”). The informationprocessing device 100 may transmit the corrected motion information tothe terminal device 10 used by the normal user. The terminal device 10displays the corrected motion information and causes the normal user torecognize the appropriate motion. As a result, the informationprocessing system 1 can cause the normal user to grasp the motionreflecting the motion of the model user, and can promote improvement ina skill, technique, and the like of the normal user.

[1-2. Configuration of an Information Processing System According to theFirst Embodiment]

The information processing system 1 illustrated in FIG. 2 will bedescribed. As illustrated in FIG. 2 , the information processing system1 includes the terminal device 10 and the information processing device100. The terminal device 10 and the information processing device 100are communicably connected in a wired or wireless manner via apredetermined communication network (network N). FIG. 2 is a viewillustrating a configuration example of the information processingsystem according to the first embodiment. Note that the informationprocessing system 1 illustrated in FIG. 2 may include a plurality ofterminal devices 10 and a plurality of information processing devices100.

The information processing device 100 is a computer that specifies, onthe basis of outline information indicating an outline of a user whomakes a body motion, a main part corresponding to the body motion and arelated part to be a target of correction processing of motioninformation corresponding to the body motion among body parts.Furthermore, the information processing device 100 is a computer thattransmits various kinds of information to the terminal device 10. Theinformation processing device 100 is a server device used to provideservices related to various functions.

Furthermore, the information processing device 100 may include softwaremodules of speech signal processing, speech recognition, speech semanticanalysis, interaction control, and the like. The information processingdevice 100 may have a function of speech recognition. For example, theinformation processing device 100 may have functions of natural languageunderstanding (NLU) and automatic speech recognition (ASR). For example,the information processing device 100 may estimate information relatedto intent (intent) and an entity (target) of the user from inputinformation according to speech of the user.

Furthermore, the information processing device 100 may be able toacquire information from a speech recognition server that provides aspeech recognition service. In this case, the information processingsystem 1 may include the speech recognition server. For example, byappropriately using various related arts, the information processingdevice 100 or the speech recognition server recognizes the speech of theuser or specifies the user who speaks.

The terminal device 10 is a terminal device that detects, by a sensorthe outline information indicating the outline of the user who makes thebody motion. For example, the terminal device 10 detects, by the imagesensor 171, image information indicating the outline of the user whomakes the body motion. The terminal device 10 is an informationprocessing device that transmits the outline information of the user tothe server device such as the information processing device 100.

The terminal device 10 is device equipment used by the user. Theterminal device 10 receives an input by the user. The terminal device 10receives a voice input by the speech of the user or an input byoperation by the user. The terminal device 10 displays informationcorresponding to the input by the user. The terminal device 10 may beany device as long as the processing in the first embodiment can berealized. The terminal device 10 may be any device as long as a functionof detecting the outline information of the user and performingtransmission thereof to the information processing device 100 isincluded. For example, the terminal device 10 may be a television,smartphone, tablet terminal, notebook personal computer (PC), desktopPC, cellular phone, personal digital assistant (PDA), or the like.

[1-3. Configuration of an Information Processing Device According to theFirst Embodiment]

Next, a configuration of the information processing device 100 that isan example of the information processing device that executes theinformation processing according to the first embodiment will bedescribed. FIG. 3 is a view illustrating a configuration example of theinformation processing device 100 according to the first embodiment ofthe present disclosure.

As illustrated in FIG. 3 , the information processing device 100includes a communication unit 110, a storage unit 120, and a controlunit 130. Note that the information processing device 100 includes aninput unit (such as keyboard or mouse) that receives various kinds ofoperation from an administrator or the like of the informationprocessing device 100, and a display unit (such as liquid-crystaldisplay) to display various kinds of information.

The communication unit 110 is realized, for example, by a networkinterface card (NIC) or the like. Then, the communication unit 110 isconnected to the network N (see FIG. 2 ) in a wired or wireless manner,and transmits/receives information to/from another informationprocessing device such as the terminal device 10 or the speechrecognition server. Furthermore, the communication unit 110 maytransmit/receive information to/from a user terminal (not illustrated)used by the user.

The storage unit 120 is realized by a semiconductor memory element suchas a random access memory (RAM) or a flash memory, or a storage devicesuch as a hard disk or an optical disk, for example. As illustrated inFIG. 3 , the storage unit 120 according to the first embodiment includesa motion information storage unit 121, a user information storage unit122, a part information storage unit 123, and a function informationstorage unit 124.

The motion information storage unit 121 according to the firstembodiment stores various kinds of information related to the bodymotion of the user. The motion information storage unit 121 storesvarious kinds of information such as attribute information of the userand motion information corresponding to the body motion of the user.Data indicated by data DT1 indicates a structure of the motion data(motion information). Although only pieces of data DT1 to DT3 areillustrated in the example of FIG. 4 , the pieces of data DT1 to DT3 arenot limitations and many pieces of data are included. Note that asindicated in “attribute information”, a case where attribute informationof a virtual character (hereinafter, also referred to as “avatar”) to bemoved by the user is included is illustrated as an example in theexample of FIG. 4 . However, in a case where the body motion of the useris simply used as an input, the attribute information of the virtualcharacter may not be included. Note that in a case of being used as amotion of the virtual character, the body motion of the user is includedin the attribute information of the virtual character in the motioninformation storage unit 121. This point will be described later.

The “user attribute information” illustrated in FIG. 4 indicatesattribute information of the user to which information this motion datais adapted. The “user attribute information” in the data DT1 in FIG. 4indicates attribute information of a user who is a man in his fiftiesand has a body shape of “TYPE4”. For example, the information of the“user attribute information” in the data DT1 in FIG. 4 corresponds tothe attribute information of the user U1 illustrated in FIG. 1 . Thedata DT1 indicates data (motion information) generated by a body motionof the user who is the man in his fifties and has the body shape of“TYPE4”.

The “motion information” illustrated in FIG. 4 includes an array ofmotion kinds and coefficients for correction by main part. Speech Intentin the “motion information” is used in a case where a main part or thelike is specified from speech. Each of the coefficients may act on amotion amount of each part of the user as a constant, or a valueconsidering each of the coefficients in proportion to the motion amountof the main part may be used.

Furthermore, for example, a coefficient is set between “−1” and “1”. Forexample, in a case where the coefficient is “0”, it is indicated thatthe motion is not corrected. Furthermore, for example, in a case wherethe coefficient is smaller than “0”, it is indicated that correction ofreducing the motion is performed. For example, in a case where thecoefficient is “−1”, it is indicated that the motion is canceled. Forexample, in a case where the coefficient is larger than “0”, it isindicated that correction of emphasizing the motion is performed.

The “motion information” in the data DT1 in FIG. 4 includes a group ofpieces of motion information. For example, the “motion information” inthe data DT1 in FIG. 4 includes a group of pieces of motion informationarranged in time series. For example, the first motion information amongthe pieces of “motion information” in the data DT1 in FIG. 4 indicatesthat, in a case where the motion of rotating the head that is the mainpart among the body parts of the user is performed, the related partsthereof are the left wrist and the right wrist. Furthermore, relatedpart-specific coefficients indicate that the rotation of the left wristis “−0.5” and the rotation of the right wrist is “−0.2”. In this case,it is indicated that the rotation of the left wrist is corrected by“−0.5” and the rotation of the right wrist is corrected by “−0.2” withrespect to the motion information corresponding to the body part of theuser.

Furthermore, the speech intent is “CHEER_UP” and it is indicated that acorresponding motion is intended to cheer up. Note that the motioninformation may not include the speech intent. Furthermore, in theexample of FIG. 4 , a case where the group of pieces of motioninformation is stored in the form of the array is illustrated. However,the array is not a limitation, and any form is possible as long ascontext of pieces of motion information can be specified.

Note that the motion information storage unit 121 may store not only theabove but also various kinds of information depending on a purpose.

The user information storage unit 122 according to the first embodimentstores various kinds of information related to the user. For example,the user information storage unit 122 stores the various kinds ofinformation such as attribute information of each user.

The user information storage unit 122 stores the information related tothe user, such as a user ID, age, gender, and place of residence. Forexample, the user information storage unit 122 stores informationrelated to the user U1, such as an age, gender, and place of residenceof the user U1 in association with a user ID “U1” for identifying theuser U1.

Furthermore, the user information storage unit 122 stores informationfor identifying a device (such as television or smartphone) used by eachuser in association with the user. The user information storage unit 122stores information for identifying the terminal device 10 used by eachuser (such as terminal ID) in association with the user.

Note that the user information storage unit 122 may store not only theabove but also various kinds of information depending on a purpose. Forexample, the user information storage unit 122 may store not only theage and gender but also other demographic attribute information andpsychographic attribute information. For example, the user informationstorage unit 122 may store information such as a name, home, place ofwork, interest, family structure, income, and lifestyle.

The part information storage unit 123 according to the first embodimentstores various kinds of information related to the body parts. Forexample, the part information storage unit 123 stores, as the definitioninformation, information in which a corresponding related part isassociated to each combination of a main part and a motion type. FIG. 5is a view illustrating an example of the part information storage unitaccording to the first embodiment of the present disclosure.

The part information storage unit 123 illustrated in FIG. 5 includesitems such as a “main part”, “motion type”, and “related part”.Furthermore, in the example of FIG. 5 , a case where items such as “#1”and “#2” are included in the “main part” and items such as “#1”, “#2”,“#3”, and “#4” are included in the “related part” is illustrated. Notethat the “main part” is not limited to “#1” and “#2”, and may include asmany items as main parts and include “#3” and “#4”, for example. Also,the “related part” is not limited to “#1”, “#2”, “#3”, and “#4” and mayinclude as many items as related parts and include “#5” and “#6”, forexample.

The “main part” indicates a main part corresponding to the body motionof the user. For example, the “main part” indicates a body motion of theuser which motion is a main motion in a motion of a corresponding motiontype. The “main part” indicates a part where an amount of change in aposition due to the body motion of the user is large. For example, the“main part” indicates a part where the amount of change in the positiondue to the body motion of the user is the largest. Note thatidentification information for identifying each part (such as part ID)may be stored in the “main part”.

The “motion type” indicates a motion type. The “motion type” indicates aname of the motion type. Note that identification information foridentifying each motion type (such as motion type ID) may be stored inthe “motion type”.

The “related part” indicates a part corresponding to a combination of acorresponding main part and motion type. The “related part” indicates apart that moves along with the motion of the main part during the motionof the corresponding motion type. The “related part” indicates a part tobe a target of correction processing of the motion informationcorresponding to the body motion. Note that identification informationfor identifying each part (such as part ID) may be stored in the“related part”.

In the example of FIG. 5 , it is indicated that two parts “L_WRIST” and“R_WRIST” are related parts corresponding to a combination of the mainpart “HEAD” and the motion type “ROTATE”. That is, it is indicated that,in a case where the motion of rotating the head that is the main partamong the body parts of the user is made, the related parts thereof arethe left wrist and the right wrist.

In addition, it is indicated that four parts “L_WRIST”, “R_WRIST”,“L_LEG”, and “R_LEG” are related parts corresponding to a combination ofthe main part “HEAD” and the motion type “MOVE”. That is, it isindicated that, in a case where the motion of rotating the head that isthe main part among the body parts of the user is made, the relatedparts thereof are the left wrist, right wrist, left leg, and right leg.

Note that the part information storage unit 123 may store not only theabove but also various kinds of information depending on a purpose. Thepart information storage unit 123 may store, in association with eachrelated part, information indicating a correction amount of a case wherethe motion of the related part is corrected (correction amountinformation). For example, the part information storage unit 123 maystore, in association with each related part, the correction amountinformation indicating how much emphasis is to be applied in a casewhere the motion of the related part is emphasized.

The function information storage unit 124 according to the firstembodiment stores various kinds of information related to a function.The function information storage unit 124 stores information related toeach function executed in response to the input by the user. Thefunction information storage unit 124 stores information related to theinput necessary for execution of the function. The function informationstorage unit 124 stores an input item necessary for execution of eachfunction. Note that the function information storage unit 124 may storenot only the above but also various kinds of information depending on apurpose.

Returning to FIG. 3 , the description is continued. The control unit 130is realized, for example, when a program (such as information processingprogram according to the present disclosure) stored in the informationprocessing device 100 is executed by a central processing unit (CPU), amicro processing unit (MPU), or the like with a random access memory(RAM) or the like as a work area. Also, the control unit 130 is realizedby, for example, an integrated circuit such as an application specificintegrated circuit (ASIC) or a field programmable gate array (FPGA).

As illustrated in FIG. 3 , the control unit 130 includes an acquisitionunit 131, a specification unit 132, a correction unit 133, an executionunit 134, and a transmission unit 135, and realizes or executes afunction and an action of information processing described below. Notethat an internal configuration of the control unit 130 is not limited tothe configuration illustrated in FIG. 3 , and may be anotherconfiguration as long as being a configuration of performing informationprocessing described later. Also, a connection relationship of eachprocessing unit included in the control unit 130 is not limited to theconnection relationship illustrated in FIG. 3 , and may be anotherconnection relationship.

The acquisition unit 131 acquires various kinds of information. Theacquisition unit 131 acquires the various kinds of information from anexternal information processing device. The acquisition unit 131acquires the various kinds of information from the terminal device 10.The acquisition unit 131 acquires, from the terminal device 10, thevarious kinds of information detected by a sensor unit 17 of theterminal device 10. The acquisition unit 131 acquires, from the terminaldevice 10, the various kinds of information detected by the image sensor171 of the sensor unit 17. The acquisition unit 131 acquires the variouskinds of information from other information processing devices such as aspeech recognition server.

The acquisition unit 131 acquires the various kinds of information fromthe storage unit 120. The acquisition unit 131 acquires the variouskinds of information from the motion information storage unit 121, theuser information storage unit 122, the part information storage unit123, and the function information storage unit 124. The acquisition unit131 acquires the various kinds of information specified by thespecification unit 132. The acquisition unit 131 acquires the variouskinds of information corrected by the correction unit 133.

The acquisition unit 131 acquires outline information indicating anoutline of the user who makes the body motion. The acquisition unit 131acquires the outline information detected by the sensor. The acquisitionunit 131 acquires the outline information that is image informationdetected by the image sensor. The acquisition unit 131 acquires speechinformation of the user. The acquisition unit 131 acquires outlineinformation of the user who performs the input by the body motion. Theacquisition unit 131 acquires definition information indicatingassociation between the main part and the related part.

The acquisition unit 131 acquires, as the outline information, movingimage information including a plurality of frames. The acquisition unit131 acquires the outline information indicating the body motion of theuser U1. The acquisition unit 131 acquires, as the outline information,a plurality of pieces of image information such as image informationcorresponding to a state ST1 and image information corresponding to thestate ST2.

The specification unit 132 specifies various kinds of information. Thespecification unit 132 determines the various kinds of information. Thespecification unit 132 makes various kinds of determination. Thespecification unit 132 judges the various kinds of information. Forexample, the specification unit 132 specifies various kinds ofinformation on the basis of the information from the externalinformation processing device or the information stored in the storageunit 120. The specification unit 132 specifies the various kinds ofinformation on the basis of the information from the other informationprocessing devices such as the terminal device 10 and the speechrecognition server. The specification unit 132 specifies the variouskinds of information on the basis of the information stored in themotion information storage unit 121, the user information storage unit122, the part information storage unit 123, or the function informationstorage unit 124. The specification unit 132 extracts the various kindsof information. For example, the specification unit 132 extracts thevarious kinds of information on the basis of the information from theexternal information processing device or the information stored in thestorage unit 120.

The specification unit 132 specifies the various kinds of information onthe basis of the various kinds of information acquired by theacquisition unit 131. The specification unit 132 specifies the variouskinds of information on the basis of the various kinds of informationcorrected by the correction unit 133. The specification unit 132 makesvarious kinds of determination on the basis of the specification. Thevarious kinds of determination are made on the basis of the informationacquired by the acquisition unit 131.

On the basis of the outline information acquired by the acquisition unit131, the specification unit 132 specifies, among the body parts, a mainpart corresponding to a body motion and a related part to be a target ofcorrection processing of motion information corresponding to the bodymotion. The specification unit 132 specifies a related part to be atarget of cancelation of an influence of the body motion. Thespecification unit 132 specifies a related part to be a target ofemphasis on the influence of the body motion.

The specification unit 132 specifies the main part on the basis of aconversion amount of a position of each of the body parts of the user.The specification unit 132 specifies, as the main part, a part having alarge conversion amount of the position among the body parts. Thespecification unit 132 specifies the main part on the basis of speechinformation of the user. The specification unit 132 specifies therelated part on the basis of the speech information of the user. Thespecification unit 132 specifies the main part on the basis of thespeech intent of the user which intent is estimated from speech contentsof the user. The specification unit 132 specifies, as the related part,a moving part among parts other than the main part corresponding to thespeech intent of the user.

The specification unit 132 specifies the related part on the basis ofthe definition information. The specification unit 132 specifies themain part corresponding to an input by the user. The specification unit132 specifies, as the related part, a part that moves along with themotion of the main part.

The specification unit 132 specifies a function execution of which isinstructed by the user. The specification unit 132 specifies thefunction corresponding to the motion information of the user. Thespecification unit 132 specifies the function on the basis of the motioninformation of the user. The specification unit 132 specifies thefunction on the basis of the motion information corrected by thecorrection unit 133.

For example, the specification unit 132 estimates the intent of thespeech of the user by the function of natural language understanding.The specification unit 132 estimates the intent of the speech of theuser by using the technology of natural language understanding or entityanalysis.

The specification unit 132 specifies, as the main part, a part having alarge amount of change in the body motion of the user U1 between thestate ST1 and state ST2. The specification unit 132 specifies, as themain part M1, the head HD that is the part having the large amount ofchange between the state ST1 and the state ST2 among the body parts ofthe user U1. The specification unit 132 specifies the motion type of theuser U1 on the basis of a motion of the head HD that is the main part M1between the state ST1 and the state ST2. Since the user U1 makes amotion of tilting (rotating) the head between the state ST1 and thestate ST2, the specification unit 132 specifies the motion type as“ROTATE”.

The specification unit 132 specifies the related part on the basis ofthe head HD that is the main part M1 between the state ST1 and the stateST2 and the motion type “ROTATE”. The specification unit 132 specifiesthe right wrist RW and the left wrist LW of the user U1 as related partscorresponding to the motion of rotating the head by the user U1. Thespecification unit 132 specifies the right wrist RW as the related partR1 and specifies the left wrist LW as the related part R2.

The correction unit 133 corrects various kinds of information. Thecorrection unit 133 corrects the various kinds of information on thebasis of the information from the external information processing deviceor the information stored in the storage unit 120. The correction unit133 corrects the various kinds of information on the basis of theinformation from the other information processing devices such as theterminal device 10 and the speech recognition server. The correctionunit 133 corrects the various kinds of information on the basis of theinformation stored in the motion information storage unit 121, the userinformation storage unit 122, the part information storage unit 123, orthe function information storage unit 124.

The correction unit 133 corrects the various kinds of information on thebasis of the various kinds of information acquired by the acquisitionunit 131. The correction unit 133 corrects the various kinds ofinformation on the basis of the various kinds of information specifiedby the specification unit 132. The correction unit 133 corrects thevarious kinds of information on the basis of processing executed by theexecution unit 134.

The correction unit 133 corrects motion information corresponding to therelated parts specified by the specification unit 132. The correctionunit 133 corrects motion information corresponding to the main partspecified by the specification unit 132.

The correction unit 133 performs correction of cancelling the motion ofthe right wrist RW that is the related part R1. The correction unit 133performs correction of returning the position of the right wrist RW inthe state ST2 to the position of the right wrist RW in the state ST1.The correction unit 133 corrects the state ST2 before the correction toa state in which the position of the right wrist RW is returned to theposition of the state ST1 and only the head HD is tilted as in the stateST3 after the correction.

The execution unit 134 executes various kinds of processing. Theexecution unit 134 determines to execute the various kinds ofprocessing. The execution unit 134 executes the various kinds ofprocessing on the basis of the information from the external informationprocessing device. The execution unit 134 executes the various kinds ofprocessing on the basis of the information stored in the storage unit120. The execution unit 134 executes the various kinds of processing onthe basis of the information stored in the motion information storageunit 121, the user information storage unit 122, the part informationstorage unit 123, or the function information storage unit 124.

The execution unit 134 executes the various kinds of processing on thebasis of the various kinds of information acquired by the acquisitionunit 131. The execution unit 134 executes the various kinds ofprocessing on the basis of the various kinds of information specified bythe specification unit 132. The execution unit 134 executes the variouskinds of processing on the basis of the various kinds of informationcorrected by the correction unit 133.

The execution unit 134 generates various kinds of information. Theexecution unit 134 generates the various kinds of information on thebasis of the information from the external information processing deviceor the information stored in the storage unit 120. The execution unit134 generates the various kinds of information on the basis of theinformation from the other information processing devices such as theterminal device 10 and the speech recognition server. The execution unit134 generates the various kinds of information on the basis of theinformation stored in the motion information storage unit 121, the userinformation storage unit 122, the part information storage unit 123, orthe function information storage unit 124.

The execution unit 134 generates motion information from imageinformation acquired by imaging of the user. The execution unit 134generates the motion information from a plurality of pieces of imageinformation acquired by imaging of the user. The execution unit 134generates the motion information corresponding to the user on the basisof a difference between the plurality of pieces of image informationacquired by imaging of the user. The execution unit 134 generates themotion information corresponding to the body motion of the user betweenthe state ST1 and the state ST2.

The transmission unit 135 transmits various kinds of information. Thetransmission unit 135 transmits the various kinds of information to theexternal information processing device. The transmission unit 135provides the various kinds of information to the external informationprocessing device. For example, the transmission unit 135 transmits thevarious kinds of information to the other information processing devicessuch as the terminal device 10 and the speech recognition server. Thetransmission unit 135 provides the information stored in the storageunit 120. The transmission unit 135 transmits the information stored inthe storage unit 120.

The transmission unit 135 provides the various kinds of information onthe basis of the information from the other information processingdevices such as the terminal device 10 and the speech recognitionserver. The transmission unit 135 provides the various kinds ofinformation on the basis of the information stored in the storage unit120. The transmission unit 135 provides the various kinds of informationon the basis of the information stored in the motion information storageunit 121, the user information storage unit 122, the part informationstorage unit 123, or the function information storage unit 124.

The transmission unit 135 transmits, to the terminal device 10,information indicating a function to be executed by the terminal device10. The transmission unit 135 transmits, to the terminal device 10,information indicating the function determined to be executed by theexecution unit 134.

[1-4. Configuration of a Terminal Device According to the FirstEmbodiment]

Next, a configuration of the terminal device 10, which is an example ofthe information processing device that executes the informationprocessing according to the first embodiment, will be described. FIG. 6is a view illustrating a configuration example of the terminal deviceaccording to the first embodiment of the present disclosure.

As illustrated in FIG. 6 , the terminal device 10 includes acommunication unit 11, an input unit 12, an output unit 13, a storageunit 14, a control unit 15, a display unit 16, and a sensor unit 17.

The communication unit 11 is realized, for example, by a NIC, acommunication circuit, or the like. The communication unit 11 isconnected to the network N (such as the Internet) in a wired or wirelessmanner, and transmits/receives information to/from other devices such asthe information processing device 100 via the network N.

The input unit 12 receives various kinds of input. The input unit 12receives detection by the sensor unit 17 as an input. The input unit 12receives an input of the outline information indicating the outline ofthe user who makes the body motion. The input unit 12 receives the inputof the outline information detected by the sensor unit 17. The inputunit 12 receives the input of the outline information that is the imageinformation detected by the image sensor 171. The input unit 12 receivesan input of the speech information of the user. The input unit 12receives the input of the outline information of the user who performsthe input by the body motion. The input unit 12 receives a gesture or agaze of the user as the input.

Various kinds of operation are input from the user to the input unit 12.The input unit 12 receives sound as the input by the sensor unit 17having a function of detecting speech. The input unit 12 receives, asinput information, speech information detected by a microphone (soundsensor) that detects speech. The input unit 12 receives a voice by thespeech of the user as the input information.

Furthermore, the input unit 12 may receive, as an operation input by theuser, operation (user operation) on the terminal device 10 used by theuser. The input unit 12 may receive, via the communication unit 11,information related to operation by the user using a remote controller(remote controller). Furthermore, the input unit 12 may include a buttonprovided on the terminal device 10, or a keyboard or a mouse connectedto the terminal device 10.

For example, the input unit 12 may have a touch panel capable ofrealizing functions equivalent to those of a remote controller, akeyboard, and a mouse. In this case, various kinds of information areinput to the input unit 12 via the display unit 16. The input unit 12receives various kinds of operation from the user via a display screenby the function of the touch panel realized by various sensors. That is,the input unit 12 receives various kinds of operation from the user viathe display unit 16 of the terminal device 10. For example, the inputunit 12 receives operation such as designation operation by the user viathe display unit 16 of the terminal device 10. For example, the inputunit 12 functions as a reception unit that receives the operation by theuser by the function of the touch panel. In this case, the input unit 12and a reception unit 153 may be integrated. Note that a capacitivesensing method is mainly employed in the tablet terminal as a detectionmethod for the operation of the user by the input unit 12. However, anymethod such as a resistive film method, a surface acoustic wave method,an infrared method, and an electromagnetic induction method that areother detection methods may be employed as long as the operation of theuser can be detected and the function of the touch panel can berealized.

For example, the input unit 12 receives the speech of the user U1 as aninput. The input unit 12 receives, as the input, the speech of the userU1 which speech is detected by the sensor unit 17. The input unit 12receives, as the input, the speech of the user U1 which speech isdetected by the sound sensor of the sensor unit 17.

The output unit 13 outputs various kinds of information. The output unit13 has a function of outputting sound. For example, the output unit 13includes a speaker that outputs sound. The output unit 13 outputsinformation by sound to the user. The output unit 13 outputs theinformation displayed on the display unit 16 by sound.

The storage unit 14 is realized, for example, by a semiconductor memoryelement such as a RAM or a flash memory, or a storage device such as ahard disk or an optical disk. The storage unit 14 stores various kindsof information used for displaying information.

Returning to FIG. 6 , the description is continued. The control unit 15is realized, for example, when a program (such as display program of theinformation processing program according to the present disclosure, orthe like) stored in the terminal device 10 is executed by a CPU, MPU, orthe like with a RAM or the like as a work area. Also, the control unit15 may be realized by, for example, an integrated circuit such as anASIC or an FPGA.

As illustrated in FIG. 6 , the control unit 15 includes a receiving unit151, an execution unit 152, a reception unit 153, and a transmissionunit 154, and realizes or executes a function and an action ofinformation processing described below. Note that an internalconfiguration of the control unit 15 is not limited to the configurationillustrated in FIG. 6 , and may be another configuration as long asbeing a configuration of performing information processing describedlater.

The receiving unit 151 receives various kinds of information. Thereceiving unit 151 receives the various kinds of information from theexternal information processing device. The receiving unit 151 receivesthe various kinds of information from other information processingdevices such as the information processing device 100 and the speechrecognition server.

The receiving unit 151 receives an instruction to execute variousfunctions from the information processing device 100. For example, thereceiving unit 151 receives information of designating a function fromthe information processing device 100 as the instruction to execute thefunction. The receiving unit 151 receives content. The receiving unit151 receives the content to be displayed from the information processingdevice 100.

The execution unit 152 executes various kinds of processing. Theexecution unit 152 determines to execute the various kinds ofprocessing. The execution unit 152 executes the various kinds ofprocessing on the basis of the information from the external informationprocessing device. The execution unit 152 executes the various kinds ofprocessing on the basis of the information from the informationprocessing device 100. The execution unit 152 executes the various kindsof processing according to the instruction from the informationprocessing device 100. The execution unit 152 executes the various kindsof processing on the basis of the information stored in the storage unit14.

The execution unit 152 controls various kinds of display. The executionunit 152 controls the display on the display unit 16. The execution unit152 controls the display on the display unit 16 in response to thereception by the receiving unit 151. The execution unit 152 controls thedisplay on the display unit 16 on the basis of information received bythe receiving unit 151. The execution unit 152 controls the display onthe display unit 16 on the basis of information received by thereception unit 153. The execution unit 152 controls the display on thedisplay unit 16 in response to the reception by the reception unit 153.

The reception unit 153 receives various kinds of information. Thereception unit 153 receives an input by the user via the input unit 12.The reception unit 153 receives speech of the user as the input. Thereception unit 153 receives operation by the user. The reception unit153 receives the operation by the user on the information displayed bythe display unit 16. The reception unit 153 receives a character inputby the user.

The transmission unit 154 transmits various kinds of information to theexternal information processing device. For example, the transmissionunit 154 transmits the various kinds of information to the otherinformation processing device such as the terminal device 10 and thespeech recognition server. The transmission unit 154 transmits theinformation stored in the storage unit 14.

The transmission unit 154 transmits the various kinds of information onthe basis of the information from the other information processingdevices such as the information processing device 100 and the speechrecognition server. The transmission unit 154 transmits the variouskinds of information on the basis of the information stored in thestorage unit 14.

The transmission unit 154 transmits the sensor information detected bythe sensor unit 17 to the information processing device 100. Thetransmission unit 154 transmits, to the information processing device100, the outline information of the user U1 which information isdetected by the image sensor 171 of the sensor unit 17.

The transmission unit 154 transmits the input information input by theuser to the information processing device 100. The transmission unit 154transmits, to the information processing device 100, the inputinformation voice input of which is performed by the user. Thetransmission unit 154 transmits the input information input by operationby the user to the information processing device 100.

The transmission unit 154 transmits, to the information processingdevice 100, the outline information indicating the outline of the userwho makes the body motion. The transmission unit 154 transmits theoutline information detected by the sensor unit 17 to the informationprocessing device 100. The transmission unit 154 transmits, to theinformation processing device 100, the outline information that is theimage information detected by the image sensor 171. The transmissionunit 154 transmits the speech information of the user to the informationprocessing device 100. The transmission unit 154 transmits, to theinformation processing device 100, the outline information of the userwho performs the input by the body motion.

The display unit 16 is provided in the terminal device 10 and displaysvarious kinds of information. The display unit 16 is realized by, forexample, a liquid crystal display, an organic electro-luminescence (EL)display, or the like. The display unit 16 may be realized by any meansas long as the information provided from the information processingdevice 100 can be displayed. The display unit 16 displays the variouskinds of information under the control by the execution unit 152.

The display unit 16 displays content. The display unit 16 displays thecontent received by receiving unit 151.

The sensor unit 17 detects predetermined information. The sensor unit 17detects the outline information indicating the outline of the user whomakes the body motion. The sensor unit 17 includes the image sensor 171as a means to detect the outline information indicating the outline ofthe user who makes the body motion. By the image sensor 171, the sensorunit 17 detects the outline information that is the image information.The sensor unit 17 detects the speech of the user. The sensor unit 17detects the outline information of the user who performs the input bythe body motion.

Furthermore, the sensor unit 17 is not limited to the image sensor 171,and may include any sensor as long as the outline information of theuser can be detected. An optical ranging sensor, an acoustic wave sensorusing an ultrasonic wave, or the like may be included as a sensor thatdetects the outline information of the user. For example, the sensorunit 17 may include a LiDAR, a ToF sensor, or the like. Furthermore, asthe sensor that detects the outline information of the user, the sensorunit 17 may include a sensor that detects heat, such as a thermalsensor.

Furthermore, the sensor unit 17 is not limited to the above, and mayinclude various sensors. The sensor unit 17 may include a sensor(position sensor) that detects position information, such as a globalpositioning system (GPS) sensor. Note that the sensor unit 17 is notlimited to the above, and may include various sensors.

[1-5. Procedure of the Information Processing According to the FirstEmbodiment]

Next, a procedure of various kinds of information processing accordingto the first embodiment will be described with reference to FIG. 7 andFIG. 8 .

[1-5-1. Procedure of Processing Related to the Information ProcessingDevice]

First, a flow of processing related to the information processing deviceaccording to the first embodiment of the present disclosure will bedescribed with reference to FIG. 7 . FIG. 7 is a flowchart illustratinga processing procedure of the information processing device according tothe first embodiment of the present disclosure. Specifically, FIG. 7 isa flowchart illustrating a procedure of information processing by theinformation processing device 100.

As illustrated in FIG. 7 , the information processing device 100acquires outline information indicating an outline of a user who makes abody motion (Step S101). Then, on the basis of the outline information,the information processing device 100 specifies, among body parts, amain part corresponding to the body motion and a related part to be atarget of correction processing of motion information corresponding tothe body motion (Step S102).

[1-5-2. Procedure of Processing Related to the Information ProcessingSystem]

Next, a flow of processing related to the information processing systemaccording to the first embodiment of the present disclosure will bedescribed with reference to FIG. 8 . FIG. 8 is a sequence diagramillustrating a processing procedure of the information processing systemaccording to the first embodiment of the present disclosure.

As illustrated in FIG. 8 , the terminal device 10 detects the outlineinformation indicating the outline of the user who makes the body motion(Step S201). For example, the terminal device 10 acquires the imageinformation of the user which information is detected by the imagesensor 171. Then, the terminal device 10 transmits, to the informationprocessing device 100, the outline information indicating the outline ofthe user who makes the body motion (Step S202).

On the basis of the outline information acquired from the terminaldevice 10, the information processing device 100 specifies, among thebody parts, the main part corresponding to the body motion and therelated part to be the target of the correction processing of the motioninformation corresponding to the body motion (Step S203). Then, theinformation processing device 100 corrects the motion information of thespecified parts (Step S204). Then, the information processing device 100specifies the function on the basis of the corrected motion information(Step S205).

Then, the information processing device 100 instructs the terminaldevice 10 to execute the specified function (Step S206). The informationprocessing device 100 instructs the terminal device 10 to execute thespecified function by transmitting information indicating the specifiedfunction to the terminal device 10. Then, the terminal device 10executes the function according to the instruction from the informationprocessing device 100 (Step S207).

[1-6. Example of Part Specification Using Speech]

The information processing device 100 may specify the main part and therelated part by using not only the outline information but also variouskinds of information as appropriate. This point will be described below.Note that description of points similar to those in FIG. 1 will beomitted as appropriate in the following description.

First, a case where intent of the user is added to a message by voicespeech and body motion will be described with FIG. 1 as an example. Inthis case, a case where the user makes a motion of tilting the headtogether with the speech in the example of FIG. 1 will be described asan example. It is assumed that the information processing system 1 canrecognize speech information of the speech of the user and estimatecontents of the speech by the functions of natural languageunderstanding and automatic speech recognition (ASR). Note that anydevice of the information processing system 1 may have the functions ofnatural language understanding and automatic speech recognition. Forexample, the functions of natural language understanding and automaticspeech recognition may be included in the information processing device100 and the terminal device 10. Furthermore, the information processingsystem 1 may include a speech recognition server having the functions ofnatural language understanding and automatic speech recognition.

The user U1 who uses the terminal device 10 speaks “coming back at7:00”. The terminal device 10 detects the speech “coming back at 7:00”by the user U1. Then, the terminal device 10 transmits characterinformation “coming back at 7:00” generated by the function of automaticspeech recognition to the information processing device 100. As aresult, the information processing device 100 acquires the characterinformation “coming back at 7:00” corresponding to the speech of theuser U1.

In addition, the user U1 makes a body motion of tilting the head. Theuser U1 makes the body motion of tilting the head after the speech“coming back at 7:00”. The information processing device 100 acquires,as the outline information, a plurality of pieces of image informationindicating the motion of the user corresponding to the state ST1 tostate ST2. The information processing device 100 acquires, as theoutline information, the image information corresponding to the stateST1 before the speech of the user U1 and the image informationcorresponding to the state ST2 after the speech of the user U1. As aresult, the information processing device 100 acquires, as the outlineinformation, the plurality of pieces of image information such as theimage information corresponding to the state ST1 and the imageinformation corresponding to the state ST2.

The information processing device 100 estimates intent of the characterinformation “coming back at 7:00” by the function of natural languageunderstanding. Furthermore, the information processing device 100specifies the intent of the user U1 on the basis of the body motion oftilting the head by the user. On the basis of the body motion of tiltingthe head by the user, the information processing device 100 specifiesthat the intent is to ask the contents of the character information“coming back at 7:00”. As a result, the information processing device100 generates a message “coming back at 7:00?” in which “?” is added tothe character information “coming back at 7:00”.

In such a manner, the information processing device 100 can moreaccurately estimate the intent of the user on the basis of the motion ofthe user. Furthermore, the information processing device 100 canappropriately generate information such as the character information byusing the intent of the user which intent is estimated on the basis ofthe motion of the user.

The information processing device 100 may switch the main part accordingto the speech contents. This point will be described with reference toFIG. 9 . FIG. 9 is a view illustrating an example of part specificationusing speech. FIG. 9 is a view illustrating an example of specifying themain part by using the speech information. The information processingdevice 100 estimates (acquires) the intent (Intent) of the user from thecontents of the voice speech, specifies a main part associated with theintent (speech intent) of the user, specifies an unnecessary motion, andcancels the motion. As an example of the use case, a case where the userspeaks “change into this much size” while walking and expresses the sizewith both hands is illustrated in FIG. 9 .

In the example of FIG. 9 , the user U1 performs movement correspondingto a state ST11 to a state ST12 by walking (Step S11). Then, the user U1makes a motion of spreading the right wrist RW and the left wrist LWwhile walking, and makes speech UT1 “change into this much size”.

Then, the information processing device 100 estimates the intent of thespeech of the user by the function of natural language understanding(NLU), and acquires body part information corresponding to the estimatedintent (Intent) (Step S12). The information processing device 100acquires the body part information corresponding to the estimated intent(Intent) from a database DB11 that stores Intent-specific body partinformation. For example, the information processing device 100 acquiresthe body part information corresponding to the estimated intent (Intent)from the storage unit 120 that stores the Intent-specific body partinformation.

In the example of FIG. 9 , the information processing device 100estimates that the intent of the speech UT1 by the user is intent ofchanging a size of an object. Then, the information processing device100 extracts, from the database DB11, the Intent-specific body partinformation that is the Intent “CHANGE_OBJECT_SIZE” corresponding to theestimated intent (Intent). The information processing device 100extracts Intent-specific body part information INF11 which is Intent“CHANGE_OBJECT_SIZE” and main parts of which are “LEFT_WRIST” and“RIGHT_WRIST”. Note that “LEFT_WRIST” may be synonymous with “L_WRIST”,and “RIGHT_WRIST” may be synonymous with “R_WRIST”.

On the basis of the intent of the speech of the user U1, the informationprocessing device 100 specifies, as main parts, the right wrist RW andthe left wrist LW having a smaller amount of change in positions thanthe right leg RL and the left leg LL instead of the right leg RL and theleft leg LL having a large amount of change in positions between thestate ST11 and the state ST12. As a result, as indicated in a stateST13, the information processing device 100 specifies the right wrist RWas a main part M11 and specifies the left wrist LW as a main part M12(Step S13).

Then, the information processing device 100 specifies a related part(Step S14). The information processing device 100 specifies, as therelated part, a moving part among parts other than the main parts M11and M12 corresponding to the speech intent of the user U1. In theexample of FIG. 9 , as indicated in a state ST14, the informationprocessing device 100 specifies the right leg RL as a related part R11and specifies the left leg LL as a related part R12.

Then, the information processing device 100 performs processing ofcorrecting the motion (Step S15). The information processing device 100performs a correction of cancelling the motion of the related part. Inthe example of FIG. 1 , the information processing device 100 performs acorrection of cancelling the motion of the right leg RL that is therelated part R11 and the left leg LL that is the related part R12. Thatis, the information processing device 100 performs a correction ofreturning the positions of the right leg RL and the left leg LL in thestate ST12 to the positions of the right leg RL and the left leg LL inthe state ST11. As a result, the information processing device 100corrects the state ST12 before the correction to a state in which thepositions of the right leg RL and the left leg LL are returned to thepositions of the state ST1 and the right wrist RW and the left wrist LWare spread as in a state ST15 after the correction.

Then, by using motion information corresponding to the state ST15, theinformation processing device 100 estimates the intent of the input bythe body motion of the user. For example, the information processingdevice 100 specifies the intent of the input by the body motion of theuser by inputting the motion information corresponding to the state ST15to a detector or the like.

In such a manner, the information processing device 100 estimates theIntent of the speech from the intent analysis of the speech of the user,and specifies the main part from the Intent-specific body partinformation. Then, the information processing device 100controls/cancels the motion of the body part which motion is not to beused as the input, and performs processing.

For example, in a case where a portion having a large amount of motionis simply set as the main part, there is a case where the amount ofmotion of a part other than the intended main part becomes s larger, forexample, during walking or the like. In such a case, there is a casewhere a correct input cannot be performed or the intent of the usercannot be appropriately estimated.

On the other hand, the information processing device 100 can receive acorrect input by controlling/canceling the motion of the body part,which motion is not to be used as the input, and performing theprocessing, and can appropriately estimate the intent of the user.

2. Second Embodiment

Hereinafter, the second embodiment will be described. The secondembodiment indicates a case where a motion is emphasized. Furthermore,in the second embodiment, a case where a user is caused to use a bodymotion to move a virtual character such as an avatar will be describedas an example. Note that description of points similar to those in thefirst embodiment will be omitted as appropriate. In the secondembodiment, an information processing system 1 includes an informationprocessing device 100A instead of the information processing device 100.

[2-1. Outline of Information Processing According to the SecondEmbodiment]

FIG. 10 is a view illustrating an example of the information processingaccording to the second embodiment of the present disclosure. Theinformation processing according to the second embodiment of the presentdisclosure is realized by the information processing system 1 includingthe information processing device 100A and a terminal device 10illustrated in FIG. 2 . An example of emphasizing a motion withpredefined data is illustrated in FIG. 10 . The information processingdevice 100A emphasizes motion data of a user along the predefined data.As an example of the use case, a case of reproducing a motion feature ofan avatar by emphasizing insufficient motion information when the motioninformation is transferred to the avatar or the like is illustrated inFIG. 10 .

In the example of FIG. 10 , a case where content CT21 including avirtual character VC21, which is an idol character (avatar) of a womanin her twenties and which moves in accordance with a body motion of auser U1, is displayed on a display unit 16 of the terminal device 10 isillustrated. For example, in a case where the idol character (avatar)such as the virtual character VC21 is operated in accordance with thebody motion of the user, there is a case where transferring the bodymotion of the user as it is as a motion of the avatar is insufficientfor the motion of the avatar. For example, in the example of FIG. 10 ,an attribute of the virtual character VC21 is the woman in her twenties,and an attribute of the user U1 is a man in his fifties. Thus, in a casewhere the idol character (avatar) such as the virtual character VC21 ofthe young woman is operated in accordance with the body motion of theuser U1 who is the middle-aged man, there is a case where transferringthe body motion of the user U1 as it is as the motion of the avatar isinsufficient for the motion of the avatar. Thus, the informationprocessing device 100A causes the avatar to make a motion suitable forthe avatar by performing a correction in such a manner as to emphasizethe motion of the user as follows.

Note that although a case where only an upper body of the virtualcharacter VC21 is displayed on the display unit 16 of the terminaldevice 10 is illustrated in order to illustrate a motion of raising aleft wrist of the user U1 in the example of FIG. 10 , the whole body ofthe virtual character VC21 may be displayed. For example, the terminaldevice 10 may display the whole body of the virtual character VC21according to an instruction or the like of the user U1. Furthermore,although a case where the terminal device 10 that detects the motion ofthe user U1 displays the content CT21 is illustrated in the example ofFIG. 10 , a terminal device 10 different from the terminal device 10that detects the motion of the user U1 may display the content CT21.

First, in the example of FIG. 10 , the terminal device 10 detects imageinformation acquired by imaging of the user U1 by an image sensor 171(Step S21). Then, the terminal device 10 transmits the detected imageinformation as outline information to the information processing device100A (Step S22). For example, the terminal device 10 transmits, as theoutline information, moving image information including a plurality ofpieces of continuously-captured image information to the informationprocessing device 100A. For example, the terminal device 10 transmits,as the outline information, moving image information including aplurality of frames to the information processing device 100A.

As a result, the information processing device 100A acquires, as theoutline information, the moving image information including theplurality of frames. The information processing device 100A acquires theoutline information indicating the body motion of the user U1. In theexample of FIG. 10 , the information processing device 100A acquires, asthe outline information, a plurality of pieces of image information suchas image information corresponding to a state ST21 and image informationcorresponding to a state ST22.

The information processing device 100A that acquires the outlineinformation performs processing of specifying a part corresponding tothe body motion of the user U1 by using the outline information. First,the information processing device 100A specifies a main partcorresponding to the body motion of the user U1 (Step S23). In theexample of FIG. 10 , the information processing device 100A specifies,as a main part M21, a left wrist LW that is a part having a large amountof change between the state ST21 and the state ST22 among body parts ofthe user U1.

Furthermore, the information processing device 100A specifies a motiontype of the user U1 between the state ST21 and the state ST22 (StepS24). The information processing device 100A specifies the motion typeof the user U1 on the basis of a motion of the left wrist LW that is themain part M21 between the state ST21 and the state ST22. In the exampleof FIG. 10 , since the user U1 performs the motion of raising a lefthand between the state ST21 and the state ST22, the informationprocessing device 100A specifies the motion type as “RAISE”.

Then, the information processing device 100A specifies a related part tobe a target of correction processing of motion information correspondingto the body motion. The information processing device 100A specifies therelated part on the basis of the left wrist LW, which is the main partM21, and the motion type “RAISE”. For example, the informationprocessing device 100A specifies the related part by using definitioninformation indicating association between the main part and the relatedpart. For example, the information processing device 100A specifies therelated part by using, among pieces of the definition information,association information in which a combination of a main part“LEFT_WRIST” indicating the left wrist and a motion type “RAISE” and therelated part are associated with each other. As a result, theinformation processing device 100A specifies a right wrist RW, a rightleg RL, and a left leg LL of the user U1 as related parts correspondingto the motion of raising the left hand by the user U1.

For example, the definition information may include information in whicheach of the right wrist RW, the right leg RL, and the left leg LL, whichare related parts, is associated with correction amount informationindicating how much each part is to be corrected. For example, thedefinition information may include information in which the correctionamount information indicating how much the right wrist RW, which is therelated part, is emphasized according to the motion of raising the leftwrist LW is associated with the related part “RIGHT_WRIST”. For example,the definition information may include information in which thecorrection amount information indicating how much the right leg RL,which is the related part, is emphasized according to the motion ofraising the left wrist LW is associated with the related part“RIGHT_LEG”. For example, the definition information may includeinformation in which the correction amount information indicating howmuch the left leg LL, which is the related part, is emphasized accordingto the motion of raising the left wrist LW is associated with therelated part “LEFT_LEG”.

Then, the information processing device 100A performs processing ofcorrecting the motion (Step S25). The information processing device 100Aperforms correction of emphasizing the motion of the related part. Inthe example of FIG. 10 , the information processing device 100A performsthe correction of emphasizing the motions of the right wrist RW that isthe related part R21, the right leg RL, and the left leg LL. Forexample, the information processing device 100A performs the correctionof emphasizing the motion of the related part by using the correctionamount information included in the definition information.

For example, the information processing device 100A performs thecorrection of respectively moving the positions of the right wrist RW,the right leg RL, and the left leg LL in the state ST22 in directions ofbecoming further away from the positions of the right wrist RW, theright leg RL, and the left leg LL in the state ST21. For example, theinformation processing device 100A performs correction of moving theposition of the right wrist RW in the state ST22 in a direction of beingfurther spread from a body BD. For example, the information processingdevice 100A performs the correction of moving the right leg RL and theleft leg LL in the state ST22 in directions of becoming further inward.Note that the above emphasis is an example, and an emphasis mode mayvary depending on the attribute of the avatar.

As a result, the information processing device 100A corrects the stateST22 before the correction to a state ST23 after the correction in whichthe positions of the right wrist RW, the right leg RL, and the left legLL are corrected to positions suitable for the motion of the virtualcharacter VC21 that is the idol character (avatar) of the woman in hertwenties. In other words, by making emphasis in such a manner that themotion information based on the motion of the user U1 matches the motionof the virtual character VC21 that is the idol character (avatar) of thewoman in her twenties, the information processing device 100A canperform the correction to the motion suitable for the avatar. As aresult, the information processing device 100A can correct the motioninformation to the motion information suitable for the attribute of theavatar, and can make it possible to provide a service using the avatarthat makes a more appropriate motion.

Note that the information processing device 100A may emphasize the mainpart in a case where the motion thereof is insufficient. For example, ina case where a raising manner is insufficient, such as when the user U1raises the left hand obliquely, the information processing device 100Amay emphasize the motion information in such a manner that the leftwrist LW is raised upward as the position of the left wrist LW isindicated in the state ST23.

[2-1-1. Background and Effects]

When the motion of the user is directly transferred to the avatar or thelike having a character property, the character property may beimpaired. Furthermore, there is a case where a restriction such as notbeing able to perform operation while sitting is generated, such as acase where whole-body information is used.

On the other hand, the information processing device 100A emphasizes themotion data of the user by using the predefined data as described above.As a result, when transferring the motion information to the avatar orthe like, the information processing device 100A can reproduce themotion feature of the avatar and control impairment of the characterproperty of the avatar or the like by emphasizing insufficient motioninformation.

[2-2. Configuration of an Information Processing Device According to theSecond Embodiment]

Next, a configuration of the information processing device 100A, whichis an example of the information processing device that executes theinformation processing according to the second embodiment, will bedescribed. FIG. 11 is a view illustrating a configuration example of theinformation processing device according to the second embodiment of thepresent disclosure.

As illustrated in FIG. 11 , the information processing device 100Aincludes a communication unit 110, a storage unit 120A, and a controlunit 130A.

The storage unit 120A is realized, for example, by a semiconductormemory element such as a RAM or a flash memory, or a storage device suchas a hard disk or an optical disk. As illustrated in FIG. 11 , thestorage unit 120A according to the second embodiment includes a motioninformation storage unit 121, a user information storage unit 122A, apart information storage unit 123, and a content generating informationstorage unit 125.

The motion information storage unit 121 according to the secondembodiment stores information in a manner illustrated in FIG. 4 . Themotion information storage unit 121 according to the second embodimentstores motion information including “attribute information” illustratedin FIG. 4 . The “attribute information” illustrated in FIG. 4 indicatesattribute information of a character (avatar) or the like assumed bythis motion data. Pieces of data DT1 to DT3 in FIG. 4 are respectivelyprepared for characters or avatars. Furthermore, a plurality of userattributes to be applied may also be prepared. In addition, what isclose to an attribute of a user is selected.

As described above, in a case of being used for a motion of the virtualcharacter, the body motion of the user is included in the attributeinformation of the virtual character in the motion information storageunit 121 as illustrated in FIG. 4 . The “attribute information” in thedata DT1 in FIG. 4 indicates attribute information of a virtualcharacter which is a woman in her twenties and has a body shape of“TYPE2”. That is, it is indicated that the data DT1 is motioninformation for causing the virtual character, which is the woman in hertwenties and has the body shape of “TYPE2”, to move. For example, theinformation of the “attribute information” in the data DT1 in FIG. 4corresponds to the attribute information of the virtual character VC21illustrated in FIG. 10 .

The user information storage unit 122A stores information similar tothat of the user information storage unit 122. The user informationstorage unit 122A stores motion information of each user. The userinformation storage unit 122A may store information indicatingassociation between each user and the virtual character.

The content generating information storage unit 125 according to thesecond embodiment stores various kinds of information used forgeneration of content. The content generating information storage unit125 stores various kinds of information used for generation of thevirtual character. The content generating information storage unit 125stores various kinds of information used for generation of contentincluding the virtual character. The content generating informationstorage unit 125 stores an editing history related to the motion of thevirtual character.

For example, the content generating information storage unit 125 storesinformation used for generation of content to be displayed on a displaydevice such as the terminal device 10. For example, the contentgenerating information storage unit 125 stores image information usedfor generation of the content. For example, the content generatinginformation storage unit 125 may store images in various formats such asJoint Photographic Experts Group (JPEG), Graphics Interchange Format(GIF), and Portable Network Graphics (PNG) as the image information usedfor generation of the content. Furthermore, the content generatinginformation storage unit 125 may store information in a format ofCascading Style Sheets (CSS), JavaScript (registered trademark), orHyperText Markup Language (HTML) as image information used forgeneration of the content. Note that the content generating informationstorage unit 125 may store not only the above but also various kinds ofinformation depending on a purpose.

As illustrated in FIG. 11 , the control unit 130A includes anacquisition unit 131A, a specification unit 132A, a correction unit133A, an execution unit 134A, and a transmission unit 135, and realizesor executes a function and an action of information processing describedbelow.

The acquisition unit 131A acquires various kinds of informationsimilarly to the acquisition unit 131. The acquisition unit 131Aacquires the various kinds of information. The acquisition unit 131Aacquires outline information of the user who moves the virtual characterby the body motion. As information used for a correction of the motioninformation of the virtual character, the acquisition unit 131A acquiresmotion information of a corresponding user corresponding to theattribute set for the virtual character. As the information used for thecorrection of the motion information of the virtual character, theacquisition unit 131A acquires an editing history related to the motionof the virtual character.

The specification unit 132A specifies various kinds of informationsimilarly to the specification unit 132. The specification unit 132Aspecifies a main part corresponding to the motion of the virtualcharacter and a related part to be a target of correction processing.The specification unit 132A specifies the main part and the related parton the basis of the motion information of the corresponding usercorresponding to the attribute set for the virtual character. Thespecification unit 132A specifies the main part and the related part onthe basis of the editing history related to the motion of the virtualcharacter.

The correction unit 133A corrects various kinds of information similarlyto the correction unit 133. The correction unit 133A performs correctionof emphasizing the motion of the main part or the related part. Thecorrection unit 133A corrects the motion information of the virtualcharacter on the basis of the editing history related to the motion ofthe virtual character. The correction unit 133A corrects the motioninformation of the virtual character by using the editing history. Thecorrection unit 133A corrects the motion information of the virtualcharacter by using a tendency of past correction included in the editinghistory. For example, the correction unit 133A applies, to the motioninformation of the virtual character to be corrected, correctioncontents of motion information similar to the motion information of thevirtual character to be corrected (similar motion information) in theediting history. The correction unit 133A corrects the motioninformation of the virtual character to be corrected with the correctioncontents of the similar motion information.

The execution unit 134A executes various kinds of information similarlyto the execution unit 134. The execution unit 134A generates variouskinds of information similarly to the execution unit 134.

The execution unit 134A generates the various kinds of information onthe basis of the various kinds of information acquired by theacquisition unit 131. The execution unit 134A generates the variouskinds of information on the basis of the various kinds of informationdetermined by the specification unit 132. The execution unit 134Agenerates the various kinds of information on the basis of the variouskinds of information corrected by the correction unit 133. The executionunit 134A generates the motion information of the virtual character onthe basis of the motion information of the corresponding usercorresponding to the attribute set for the virtual character. Theexecution unit 134A generates the motion information of the virtualcharacter by using the motion information of the similar user similar tothe attribute set for the virtual character. The execution unit 134Agenerates the motion information of the virtual character by using atendency of the motion of the similar user. For example, the executionunit 134A generates the motion information of the virtual character insuch a manner as to be similar to the motion information of the similaruser. The execution unit 134A generates the motion information of thevirtual character, which is a target of the generation, in such a manneras to be closer to the motion information of the similar user.

By appropriately using various technologies, the execution unit 134Agenerates the various kinds of information such as a screen (imageinformation) to be provided to an external information processingdevice. The execution unit 134A generates a screen (image information)or the like to be provided to the terminal device 10. For example, theexecution unit 134A generates the screen (image information) or the liketo be provided to the terminal device 10 on the basis of the informationstored in the storage unit 120. The execution unit 134A generates thecontent CT21 including the virtual character VC21. The execution unit134A may generate the content (image information) or the like by anykind of processing as long as the content (image information) or thelike to be provided to the external information processing device can begenerated. For example, the execution unit 134A generates the content(image information) to be provided to the terminal device 10 byappropriately using various technologies related to image generation,image processing, and the like. For example, the execution unit 134Agenerates the content (image information) to be provided to the terminaldevice 10 by appropriately using various technologies such as Java(registered trademark). Note that the execution unit 134A may generatethe content (image information) to be provided to the terminal device 10on the basis of a format of CSS, JavaScript (registered trademark), orHTML. Furthermore, for example, the execution unit 134A may generate thecontent (image information) in various formats such as JPEG, GIF, andPNG.

The transmission unit 135 transmits the content generated by theexecution unit 134A to the terminal device 10. For example, thetransmission unit 135 transmits the content CT21 including the virtualcharacter VC21 to the terminal device 10.

[2-3. Example of Part Specification Using Speech]

The information processing device 100A may specify the main part and therelated part by using not only the outline information but also variouskinds of information as appropriate. This point will be described below.Note that description of points similar to those in FIG. 10 will beomitted as appropriate in the following description.

The information processing device 100A may emphasize a body part inconsideration of speech contents. This point will be described withreference to FIG. 12 . FIG. 12 is a view illustrating an example of partspecification using speech. FIG. 12 is a view illustrating an example ofspecifying the main part by using speech information. The informationprocessing device 100A estimates (acquires) intent (Intent) of the userfrom contents of voice speech, and selects motion data to be used forspecification and emphasis of the main part. As an example of the usecase, a case where motion information of a portion to be emphasized isselected and used in a case where a motion of raising a hand is madewhile speech “let's try” is made at the time of usage of the idol avatar(such as virtual character VC21 in FIG. 10 ) is illustrated in FIG. 12 .

In the example of FIG. 12 , the user U1 makes a motion of raising theleft hand of the user U1 corresponding to a state ST31 to a state ST32(Step S31). Then, the user U1 makes speech UT31 “let's try” togetherwith the motion of raising the left hand of the user U1.

Then, the information processing device 100A estimates intent of thespeech of the user by the function of natural language understanding(NLU), and acquires information corresponding to the estimated intent(Intent) (hereinafter, also referred to as “part motion information”)(Step S32). The information processing device 100A acquires part motioninformation corresponding to the estimated intent (Intent) from adatabase DB31 that stores Intent-specific main part/related part/motioninformation. For example, the information processing device 100Aacquires part motion information corresponding to the estimated intent(Intent) from the storage unit 120 that stores the Intent-specific mainpart/related part/motion information.

In the example of FIG. 12 , the information processing device 100Aestimates that the intent of the speech UT31 by the user is intent ofchanging a size of an object. Then, the information processing device100A extracts, from the database DB31, the Intent-specific mainpart/related part/motion information that is intent “LETS_GET_STARTED”corresponding to the estimated intent (Intent). The informationprocessing device 100A extracts Intent-specific main part/relatedpart/motion information INF31 which is Intent part “LETS_GET_STARTED”and in which the main part is “LEFT_ARM”. Note that “LEFT_ARM” may besynonymous with “LEFT_WRIST” or “L_WRIST”. The Intent-specific mainpart/related part/motion information INF31 may include information inwhich the correction amount information indicating how much each relatedpart is corrected is associated with each related part (motion emphasisdata).

The information processing device 100A specifies the left wrist LW as amain part on the basis of the intent of the speech of the user U1. As aresult, the information processing device 100A specifies the right wristRW as a main part M31 as indicated in a state ST33 (Step S33).

Then, the information processing device 100A specifies a related part(Step S34). The information processing device 100A specifies, as therelated part, a moving part among parts other than the main part M31corresponding to the speech intent of the user U1. In the example ofFIG. 12 , as indicated in the state ST33, the information processingdevice 100A specifies the right wrist RW as a related part R31,specifies the right leg RL as a related part R32, and specifies the leftleg LL as a related part R33. For example, the information processingdevice 100A performs correction of emphasizing motions of the relatedparts by using the correction amount information included in theIntent-specific main part/related part/motion information INF31.

Then, the information processing device 100A performs processing ofcorrecting the motions (Step S35). The information processing device100A performs correction of emphasizing the motions of the relatedparts. In the example of FIG. 1 , the information processing device 100Aperforms correction of emphasizing the motion of the right wrist RW thatis the related part R31, the motion of the right leg RL that is therelated part R32, and the motion of the left leg LL that is the relatedpart R33. That is, the information processing device 100A performscorrection of respectively moving the positions of the right wrist RW,the right leg RL, and the left leg LL in the state ST34 in directions ofbecoming further away from the positions of the right wrist RW, theright leg RL, and the left leg LL in the state ST32. For example, theinformation processing device 100A performs correction of moving theposition of the right wrist RW in the state ST34 in a direction of beingfurther spread from the body BD. For example, the information processingdevice 100A performs correction of moving the right leg RL and the leftleg LL in the state ST34 in directions of becoming further inward. As aresult, the information processing device 100A performs correction to amotion in which the motion of the hand is large and the legs areemphasized to be inward as illustrated in the state ST35.

Furthermore, in a case where since the user U1 raises a handinsufficiently and the motion of the left wrist LW that is the main partM31 is also insufficient, the information processing device 100A alsoemphasizes the motion of the left wrist LW. In the example of FIG. 12 ,since the user U1 raises the left hand obliquely and the raising manneris insufficient, the information processing device 100A emphasizes themotion information in such a manner that the left wrist LW is raisedupward as the position of the left wrist LW is indicated in a stateST35. For example, the information processing device 100A performscorrection of emphasizing the motion of the main part by using thecorrection amount information related to the main part included in theIntent-specific main part/related part/motion information INF31. In thiscase, the Intent-specific main part/related part/motion informationINF31 includes information in which the correction amount informationindicating how much each main part is corrected is associated with eachmain part (motion emphasis data).

In such a manner, the information processing device 100A estimates theIntent of the speech from the intent analysis of the speech of the user,and specifies the main part from the Intent-specific main part/relatedpart/motion information. As a result, the information processing device100A can appropriately specify the main part by using the speechinformation of the user even in a case where the main part cannot bespecified only by a motion amount of a body part due to a reason thatthe motion of the main part which motion is made by the user is small,or the like. Then, the information processing device 100A makes emphasisby using the main part information and the motion emphasis dataassociated with Intent. As a result, the information processing device100A can emphasize a motion of a main part having an insufficientmotion, and emphasize a motion of a related part having an insufficientmotion. In such a manner, the information processing device 100A cancorrect the motion information to the motion information suitable forthe attribute of the avatar, and can make it possible to provide aservice using the avatar that makes a more appropriate motion.

[2-4. Example of Information Utilization According to an Attribute]

Note that the above is an example, and various kinds of information maybe appropriately used to specify a part and to correct a motion. Thispoint will be described below. Note that description of points similarto those in the above description will be omitted as appropriate in thefollowing description. Hereinafter, the following processing and thelike may be performed by the information processing device 100 althoughthe information processing device 100A will be described as an example.

For example, the information processing device 100A may use informationaccording to an attribute. This point will be described with referenceto FIG. 13 . FIG. 13 is a view illustrating an example of informationutilization according to an attribute. Hereinafter, as an example of theuse case, a case where motion data that is not predefined is acquiredwill be described. In FIG. 13 , an example of a method of automaticallyacquiring “main part/related part information” to be an informationsource for canceling/controlling/emphasizing a motion of a body part isillustrated, for example.

In the example of FIG. 13 , as indicated in attribute information INF41,a case where the virtual character VC21 is set in such a manner that agender is female, an age is in her twenties, a hairstyle is long hair, aheight is 155 cm, a weight is 50 kg, and a place of residence is theKanto region is illustrated.

The information processing device 100A generates data from a motion of auser having a close attribute (Step S41). The information processingdevice 100A generates data of the virtual character VC21 from a motionof a user close to the attribute of the virtual character VC21. Theinformation processing device 100A generates data of the virtualcharacter VC21 from a motion of a similar user similar to the attributeof the virtual character VC21. For example, the information processingdevice 100A extracts a female user in her twenties as the similar user,and generates the data of the virtual character VC21 from the motion ofthe similar user.

For example, the information processing device 100A measures a motionamount at certain time intervals with the similar user as a target.Then, the information processing device 100A stores the measured motionamount in the storage unit 120A in association with the virtualcharacter VC21. The information processing device 100A stores data DT41including the measured motion amount in association with the virtualcharacter VC21. In association with the virtual character VC21, theinformation processing device 100A stores motion information indicatingthe motion amount in a manner illustrated in a state ST41.

For example, the information processing device 100A measures near timedata at the time of speech with the similar user as the target. Then,the information processing device 100A stores the measured motion amountin the storage unit 120A in association with the virtual character VC21.In association with the virtual character VC21, the informationprocessing device 100A stores data DT42 including the measured motionamount. In association with the virtual character VC21, the informationprocessing device 100A stores motion information indicating the motionamount in a manner illustrated in a state ST42.

In such a manner, the information processing device 100A acquires, asdata, the motion of the user having the same or similar attribute as theavatar setting. As a result, the information processing device 100A canautomatically acquire information indicating a relationship between amain part and a related part and information indicating a motion amountof each part.

[2-5. Motion Editing Example]

Furthermore, for example, the information processing device 100A may usehistory information of motion editing. This point will be described withreference to FIG. 14 . FIG. 14 is a view illustrating an example ofmotion editing. Hereinafter, as an example of the use case, a case wheremotion data that is not predefined is acquired will be described. InFIG. 14 , an example of a method of automatically acquiring “mainpart/related part information” to be an information source forcanceling/controlling/emphasizing a motion of a body part isillustrated, for example.

The information processing device 100A acquires motion data expectedfrom a motion editing history of an avatar. In a case where there is afunction of correcting a motion of the avatar as an editing tool ofcontent for a social networking service (SNS) or the like, theinformation processing device 100A acquires history informationcorrected (edited) by the function. Furthermore, the informationprocessing device 100A may acquire information from completed datagenerated by an editing (PC or the like) operation after photographing.For example, the information processing device 100A may acquire adifference between data before editing (raw data) and data after theediting (completed data) as editing information.

In FIG. 14 , a case where the raw data is edited and the completed datais generated by operation by the user U1 on the input unit 12 such as amouse of the terminal device 10 is illustrated as an example. In FIG. 14, the user U1 edits motion information by operating a model, whichimitates a person and is displayed on the display unit 16 of theterminal device 10, by using a predetermined editing tool TL51 (StepS51). Note that the user U1 may directly edit character information in amanner illustrated in data DT51.

The user U1 generates data DT52 corresponding to a state ST52 by editingthe data DT51 corresponding to a state ST51. As a result, by editing thedata DT51 that is the raw data, the user U1 generates the data DT52 thatis the completed data. For example, the information processing device100A generates the data DT52 by adding editing information ED51corresponding to the editing by the user U1 to the data DT51. Theinformation processing device 100A generates the data DT52 in which themotions of the right leg RL and the left leg LL that are the relatedparts R52 and R53 are edited. For example, the information processingdevice 100A adds the right leg RL and the left leg LL to related partsof the motion information in response to the adjustment of the motionsof the right leg RL and the left leg LL by the user U1.

The information processing device 100A acquires the editing history inthe manner described above, and corrects the data by using the acquiredediting history. The information processing device 100A corrects themotion information of the virtual character by using the editinghistory. The information processing device 100A corrects the motioninformation of the virtual character by using a tendency of pastcorrection included in the editing history. For example, the informationprocessing device 100A may automatically generate completed data fromraw data automatically generated in an early stage.

3. Other Embodiments

The processing according to each of the above-described embodiments maybe performed in various different forms (modification examples) otherthan each of the above-described embodiments and modification examples.

[3-1. Other Configuration Examples]

Note that although a case where the information processing device 100 orthe information processing device 100A and the terminal device 10 areseparate bodies has been described, these devices may be integrated.That is, a device that generates content (such as information processingdevice 100) and a device that displays information such as the content(such as terminal device 10) may be integrated. For example, a deviceused by the user may be an information processing device having afunction of generating content, and a function of performing a displayof information and reception of an input by the user. In this case, forexample, the information processing device may be a television or thelike. The information processing device may acquire input information ofthe user from a terminal device (such as smart speaker or smartphone)that receives an input by the user, and may generate and display contentby using the acquired information.

[3-2. Others]

Also, among the pieces of processing described in the above embodiments,all or a part of the processing described to be automatically performedcan be manually performed, or all or a part of the processing describedto be manually performed can be automatically performed by a knownmethod. In addition, a processing procedure, specific name, andinformation including various kinds of data and parameters illustratedin the above document or drawings can be arbitrarily changed unlessotherwise specified. For example, various kinds of informationillustrated in each drawing are not limited to the illustratedinformation.

Also, each component of each of the illustrated devices is a functionalconcept, and does not need to be physically configured in a mannerillustrated in the drawings. That is, a specific form ofdistribution/integration of each device is not limited to what isillustrated in the drawings, and a whole or part thereof can befunctionally or physically distributed/integrated in an arbitrary unitaccording to various loads and usage conditions.

Also, the above-described embodiments and modification examples can bearbitrarily combined in a range in which the processing contents do notcontradict each other.

Also, the effect described in the present description is merely anexample and is not a limitation, and there may be another effect.

4. Effects According to the Present Disclosure

As described above, the information processing device according to thepresent disclosure (information processing device 100 or 100A in theembodiment) includes an acquisition unit (acquisition unit 131 or 131Ain the embodiment) and a specification unit (specification unit 132 or132A in the embodiment). The acquisition unit acquires outlineinformation indicating an outline of a user who makes a body motion. Onthe basis of outline information acquired by the acquisition unit, thespecification unit specifies, among body parts, a main partcorresponding to the body motion and a related part to be a target ofcorrection processing of motion information corresponding to the bodymotion.

In such a manner, on the basis of the outline information indicating theoutline of the user who makes the body motion, the informationprocessing device according to the present disclosure specifies, amongthe body parts, the main part corresponding to the body motion and therelated part to be the target of the correction processing of the motioninformation corresponding to the body motion. As a result, theinformation processing device can appropriately specify a part relatedto the body motion of the user by specifying the main part that is amain part of the user, and a part that is another part and is to be thetarget of the correction processing.

Also, the acquisition unit acquires the outline information detected bya sensor. Thus, the information processing device can appropriatelyspecify the part related to the body motion of the user by using theinformation detected by the sensor (sensor information).

Furthermore, the acquisition unit acquires the outline information thatis image information detected by an image sensor. As a result, theinformation processing device can appropriately specify the part relatedto the body motion of the user by using information (image) detected bythe image sensor.

Furthermore, the specification unit specifies a related part to be atarget for cancelation of an influence of the body motion. As a result,the information processing device can appropriately specify the partrelated to the body motion of the user by specifying the related part tobe the target of the cancellation of the influence of the body motion.

Furthermore, the specification unit specifies the related part to be atarget of emphasis of the influence of the body motion. As a result, theinformation processing device can appropriately specify the part relatedto the body motion of the user by specifying the related part to be thetarget of the emphasis of the influence of the body motion.

Furthermore, the specification unit specifies the main part on the basisof a conversion amount of a position of each body part of the user. As aresult, the information processing device can appropriately specify thepart related to the body motion of the user by specifying the main partaccording to the conversion amount of the position of each body part ofthe user.

Furthermore, the specification unit specifies, as the main part, a bodypart having a large conversion amount of the position. As a result, theinformation processing device can appropriately specify the part relatedto the body motion of the user by specifying, as the main part, the parthaving the large conversion amount of the position.

Furthermore, the acquisition unit acquires speech information of theuser. The specification unit specifies the main part on the basis of thespeech information of the user. As a result, the information processingdevice can appropriately specify the part related to the body motion ofthe user more accurately by specifying the main part by using theoutline information and the speech information.

Furthermore, the specification unit specifies the related part on thebasis of the speech information of the user. As a result, theinformation processing device can appropriately specify the part relatedto the body motion of the user more accurately by specifying the relatedpart on the basis of the speech information of the user by using theoutline information and the speech information.

Furthermore, the specification unit specifies the main part on the basisof speech intent of the user which intent is estimated from speechcontents of the user. As a result, the information processing device canappropriately specify the part related to the body motion of the usermore accurately by specifying the main part according to the speechintent of the user which intent is estimated from the speech contents ofthe user.

Furthermore, the specification unit specifies, as the related part, amoving part among parts other than the main part corresponding to thespeech intent of the user. As a result, the information processingdevice can appropriately specify the part related to the body motion ofthe user more accurately by specifying, as the related part, the movingpart other than the part corresponding to the speech intent of the user.

Furthermore, the acquisition unit acquires definition informationindicating association between the main part and the related part. Thespecification unit specifies the related part on the basis of thedefinition information. As a result, the information processing devicecan appropriately specify the part related to the body motion of theuser more accurately by specifying the main part by using definitioninformation indication the association between the main part and therelated part.

Furthermore, the acquisition unit acquires the outline information ofthe user who performs an input by the body motion. The specificationunit specifies the main part corresponding to the input by the user. Asa result, the information processing device can appropriately specifythe part related to the body motion of the user who performs the inputby the body motion.

Furthermore, the specification unit specifies, as the related part, apart that moves along with the motion of the main part. As a result, theinformation processing device can appropriately specify the part relatedto the body motion of the user more accurately by specifying, as therelated part, the part that moves along with the motion of the mainpart.

Furthermore, the acquisition unit acquires the outline information ofthe user who moves the virtual character by the body motion. Thespecification unit specifies a main part corresponding to the motion ofthe virtual character and a related part to be a target of correctionprocessing. As a result, the information processing device canappropriately specify the part related to the body motion of the userwho moves the virtual character by the body motion.

Furthermore, the acquisition unit acquires motion information of acorresponding user corresponding to an attribute set for the virtualcharacter as information used for generation of motion information ofthe virtual character. As a result, by using the motion information ofthe user corresponding to the attribute set for the virtual character,the information processing device can cause the virtual character tomove by using the motion information of the user similar to the virtualcharacter.

Furthermore, the acquisition unit acquires an editing history related tothe motion of the virtual character as information used for a correctionof the motion information of the virtual character. As a result, theinformation processing device can correct the motion information of thevirtual character by using the editing history related to the motion ofthe virtual character, and can cause the virtual character to move byusing a tendency of past correction.

Furthermore, the information processing device according to the presentdisclosure further includes a correction unit (correction unit 133 or133A in the embodiment). The correction unit corrects the motioninformation corresponding to the related part specified by thespecification unit. Thus, the information processing device canappropriately correct the motion information of the related part of thebody motion of the user.

Furthermore, the correction unit corrects the motion informationcorresponding to the main part specified by the specification unit.Thus, the information processing device can appropriately correct themotion information of the main part of the body motion of the user.

5. Hardware Configuration

Information equipment such as the information processing device 100 or100A, or the terminal device 10 according to each of the above-describedembodiments is realized by, for example, a computer 1000 having aconfiguration in a manner illustrated in FIG. 15 . FIG. 15 is a hardwareconfiguration diagram illustrating an example of the computer 1000 thatrealizes functions of the information processing device such as theinformation processing device 100 or 100A, or the terminal device 10. Inthe following, the information processing device 100 according to thefirst embodiment will be described as an example. The computer 1000includes a CPU 1100, a RAM 1200, a read only memory (ROM) 1300, a harddisk drive (HDD) 1400, a communication interface 1500, and aninput/output interface 1600. Each unit of the computer 1000 is connectedby a bus 1050.

The CPU 1100 operates on the basis of programs stored in the ROM 1300 orthe HDD 1400, and controls each unit. For example, the CPU 1100 expandsthe programs, which are stored in the ROM 1300 or the HDD 1400, in theRAM 1200 and executes processing corresponding to various programs.

The ROM 1300 stores a boot program such as a basic input output system(BIOS) executed by the CPU 1100 during activation of the computer 1000,a program that depends on hardware of the computer 1000, and the like.

The HDD 1400 is a computer-readable recording medium thatnon-temporarily records a program executed by the CPU 1100, data used bythe program, and the like. More specifically, the HDD 1400 is arecording medium that records the information processing programaccording to the present disclosure which program is an example ofprogram data 1450.

The communication interface 1500 is an interface with which the computer1000 is connected to an external network 1550 (such as the Internet).For example, the CPU 1100 receives data from another equipment ortransmits data generated by the CPU 1100 to another equipment via thecommunication interface 1500.

The input/output interface 1600 is an interface to connect aninput/output device 1650 and the computer 1000. For example, the CPU1100 receives data from an input device such as a keyboard or mouse viathe input/output interface 1600. Furthermore, the CPU 1100 transmitsdata to an output device such as a display, speaker, or printer via theinput/output interface 1600. Also, the input/output interface 1600 mayfunction as a medium interface that reads a program or the like recordedon a predetermined recording medium (medium). The medium is, forexample, an optical recording medium such as a digital versatile disc(DVD) or phase change rewritable disk (PD), a magneto-optical recordingmedium such as a magneto-optical disk (MO), a tape medium, a magneticrecording medium, a semiconductor memory, or the like.

For example, in a case where the computer 1000 functions as theinformation processing device 100 according to the first embodiment, theCPU 1100 of the computer 1000 realizes a function of the control unit130 or the like by executing the information processing program loadedon the RAM 1200. Also, the HDD 1400 stores an information processingprogram according to the present disclosure, and data in the storageunit 120. Note that the CPU 1100 reads the program data 1450 from theHDD 1400 and performs execution thereof, but may acquire these programsfrom another device via the external network 1550 in another example.

Note that the present technology can also have the followingconfigurations.

(1)

An information processing device comprising:

an acquisition unit that acquires outline information indicating anoutline of a user who makes a body motion; and

a specification unit that specifies, among body parts, a main partcorresponding to the body motion and a related part, which is to be atarget of correction processing of motion information corresponding tothe body motion, on a basis of the outline information acquired by theacquisition unit.

(2)

The information processing device according to (1), wherein

the acquisition unit

acquires the outline information detected by a sensor.

(3)

The information processing device according to (2), wherein

the acquisition unit

acquires the outline information that is image information detected byan image sensor.

(4)

The information processing device according to any one of (1) to (3),wherein

the specification unit

specifies the related part to be a target of cancellation of aninfluence of the body motion.

(5)

The information processing device according to any one of

(1) to (3), wherein

the specification unit

specifies the related part to be a target of emphasis of an influence ofthe body motion.

(6)

The information processing device according to any one of

(1) to (5), wherein

the specification unit

specifies the main part on a basis of a conversion amount of a positionof each of the body parts of the user.

(7)

The information processing device according to (6), wherein

the specification unit

specifies, as the main part, a part having a large conversion amount ofa position among the body parts.

(8)

The information processing device according to any one of (1) to (7),wherein

the acquisition unit

acquires speech information of the user, and

the specification unit

specifies the main part on a basis of the speech information of theuser.

(9)

The information processing device according to (8), wherein

the specification unit

specifies the related part on a basis of the speech information of theuser.

(10)

The information processing device according to (8) or (9), wherein

the specification unit

specifies the main part on a basis of speech intent of the user whichintent is estimated from speech contents of the user.

(11)

The information processing device according to (10), wherein

the specification unit

specifies, as the related part, a moving part among parts other than themain part corresponding to the speech intent of the user.

(12)

The information processing device according to any one of (1) to (11),wherein

the acquisition unit

acquires definition information indicating association between the mainpart and the related part, and

the specification unit

specifies the related part on a basis of the definition information.

(13)

The information processing device according to any one of (1) to (12),wherein

the acquisition unit

acquires the outline information of the user who performs an input bythe body motion, and

the specification unit

specifies the main part corresponding to the input by the user.

(14)

The information processing device according to (13), wherein

the specification unit

specifies, as the related part, a part that moves along with a motion ofthe main part.

(15)

The information processing device according to any one of (1) to (14),wherein

the acquisition unit

acquires the outline information of the user who moves a virtualcharacter by the body motion, and

the specification unit

specifies the main part corresponding to a motion of the virtualcharacter, and the related part to be the target of the correctionprocessing.

(16)

The information processing device according to (15), wherein

the acquisition unit

acquires, as information used for generation of motion information ofthe virtual character, motion information of a corresponding usercorresponding to an attribute that is set for the virtual character.

(17)

The information processing device according to (15) or (16), wherein

the acquisition unit

acquires, as information used for a correction of motion information ofthe virtual character, an editing history related to the motion of thevirtual character.

(18)

The information processing device according to any one of (1) to (17),further comprising

a correction unit that corrects the motion information corresponding tothe related part specified by the specification unit.

(19)

The information processing device according to (18), wherein

the correction unit

corrects the motion information corresponding to the main part specifiedby the specification unit.

(20)

An information processing method comprising:

executing processing of

acquiring outline information indicating an outline of a user who makesa body motion, and

specifying, among body parts, a main part corresponding to the bodymotion and a related part, which is to be a target of correctionprocessing of information corresponding to the body motion, on a basisof the acquired outline information.

REFERENCE SIGNS LIST

-   -   1 INFORMATION PROCESSING SYSTEM    -   100, 100A INFORMATION PROCESSING DEVICE    -   110 COMMUNICATION UNIT    -   120, 120A STORAGE UNIT    -   121 MOTION INFORMATION STORAGE UNIT    -   122 USER INFORMATION STORAGE UNIT    -   123 PART INFORMATION STORAGE UNIT    -   124 FUNCTION INFORMATION STORAGE UNIT    -   125 CONTENT GENERATING INFORMATION STORAGE UNIT    -   130, 130A CONTROL UNIT    -   131 ACQUISITION UNIT    -   132 SPECIFICATION UNIT    -   133, 133A CORRECTION UNIT    -   134, 134A EXECUTION UNIT    -   135 TRANSMISSION UNIT    -   10 TERMINAL DEVICE    -   11 COMMUNICATION UNIT    -   12 INPUT UNIT    -   13 OUTPUT UNIT    -   14 STORAGE UNIT    -   15 CONTROL UNIT    -   151 RECEIVING UNIT    -   152 EXECUTION UNIT    -   153 RECEPTION UNIT    -   154 TRANSMISSION UNIT    -   16 DISPLAY UNIT

1. An information processing device comprising: an acquisition unit that acquires outline information indicating an outline of a user who makes a body motion; and a specification unit that specifies, among body parts, a main part corresponding to the body motion and a related part, which is to be a target of correction processing of motion information corresponding to the body motion, on a basis of the outline information acquired by the acquisition unit.
 2. The information processing device according to claim 1, wherein the acquisition unit acquires the outline information detected by a sensor.
 3. The information processing device according to claim 2, wherein the acquisition unit acquires the outline information that is image information detected by an image sensor.
 4. The information processing device according to claim 1, wherein the specification unit specifies the related part to be a target of cancellation of an influence of the body motion.
 5. The information processing device according to claim 1, wherein the specification unit specifies the related part to be a target of emphasis of an influence of the body motion.
 6. The information processing device according to claim 1, wherein the specification unit specifies the main part on a basis of a conversion amount of a position of each of the body parts of the user.
 7. The information processing device according to claim 6, wherein the specification unit specifies, as the main part, a part having a large conversion amount of a position among the body parts.
 8. The information processing device according to claim 1, wherein the acquisition unit acquires speech information of the user, and the specification unit specifies the main part on a basis of the speech information of the user.
 9. The information processing device according to claim 8, wherein the specification unit specifies the related part on a basis of the speech information of the user.
 10. The information processing device according to claim 8, wherein the specification unit specifies the main part on a basis of speech intent of the user which intent is estimated from speech contents of the user.
 11. The information processing device according to claim 10, wherein the specification unit specifies, as the related part, a moving part among parts other than the main part corresponding to the speech intent of the user.
 12. The information processing device according to claim 1, wherein the acquisition unit acquires definition information indicating association between the main part and the related part, and the specification unit specifies the related part on a basis of the definition information.
 13. The information processing device according to claim 1, wherein the acquisition unit acquires the outline information of the user who performs an input by the body motion, and the specification unit specifies the main part corresponding to the input by the user.
 14. The information processing device according to claim 13, wherein the specification unit specifies, as the related part, a part that moves along with a motion of the main part.
 15. The information processing device according to claim 1, wherein the acquisition unit acquires the outline information of the user who moves a virtual character by the body motion, and the specification unit specifies the main part corresponding to a motion of the virtual character, and the related part to be the target of the correction processing.
 16. The information processing device according to claim 15, wherein the acquisition unit acquires, as information used for generation of motion information of the virtual character, motion information of a corresponding user corresponding to an attribute that is set for the virtual character.
 17. The information processing device according to claim 15, wherein the acquisition unit acquires, as information used for a correction of motion information of the virtual character, an editing history related to the motion of the virtual character.
 18. The information processing device according to claim 1, further comprising a correction unit that corrects the motion information corresponding to the related part specified by the specification unit.
 19. The information processing device according to claim 18, wherein the correction unit corrects the motion information corresponding to the main part specified by the specification unit.
 20. An information processing method comprising: executing processing of acquiring outline information indicating an outline of a user who makes a body motion, and specifying, among body parts, a main part corresponding to the body motion and a related part, which is to be a target of correction processing of information corresponding to the body motion, on a basis of the acquired outline information. 